feat: Add azurefunctions-extensions-bindings-kafka for KafkaRecord binding (#155)#156
Open
TsuyoshiUshio wants to merge 1 commit intoAzure:devfrom
Open
feat: Add azurefunctions-extensions-bindings-kafka for KafkaRecord binding (#155)#156TsuyoshiUshio wants to merge 1 commit intoAzure:devfrom
TsuyoshiUshio wants to merge 1 commit intoAzure:devfrom
Conversation
…ecord binding New package enabling Python users to bind to raw Apache Kafka records with full metadata access via Protobuf deserialization. Package structure (follows EventHub pattern): - kafkaRecord.py: KafkaRecord(SdkType) with Protobuf decoder, KafkaHeader, KafkaTimestamp, KafkaTimestampType types - kafkaRecordConverter.py: InConverter for kafkaTrigger binding, supports model_binding_data (single) and collection_model_binding_data (batch) - 11 unit tests covering full record, null key/value, null leader epoch, unknown timestamp type, batch, headers, type annotations - Sample app with function_app.py, host.json, local.settings.json, README - CI: Added to build.yml, build-artifacts.yml, unit-tests.yml matrices No changes needed to python-library or python-worker. Fixes Azure#155 Relates to Azure/azure-functions-kafka-extension#612 Co-authored-by: Dobby <dobby@microsoft.com>
TsuyoshiUshio
requested review from
gavin-aguiar,
hallvictoria and
vrdmr
as code owners
This was referenced Apr 28, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add
azurefunctions-extensions-bindings-kafkapackage enabling Python users to bind to raw Apache Kafka records (KafkaRecordtype) with full metadata access via Protobuf deserialization.Issue
Fixes #155
Relates to Azure/azure-functions-kafka-extension#612
Changes
New package:
azurefunctions-extensions-bindings-kafka/kafkaRecord.pyKafkaRecord(SdkType)with Protobuf wire format decoder.KafkaHeader,KafkaTimestamp,KafkaTimestampTypetypeskafkaRecordConverter.pyInConverterforkafkaTriggerbinding — handlesmodel_binding_data(single) andcollection_model_binding_data(batch)__init__.pytests/test_kafka_record.pysamples/kafka_samples_kafkarecord/function_app.py,host.json,local.settings.json,requirements.txt,README.mdpyproject.tomlazurefunctions-extensions-base>=1.1.0,protobuf>=4.0.0,<6.0CI updates:
eng/templates/jobs/build.yml— kafka_extension entryeng/templates/official/jobs/build-artifacts.yml— kafka_extension entryeng/templates/official/jobs/unit-tests.yml— KafkaTests job (Python 3.9–3.13)No changes needed to
azure-functions-python-libraryorazure-functions-python-worker.Breaking Changes
None. New package — all existing Kafka bindings (
str,bytes,KafkaEvent) continue to work.Testing
User Experience